Only W2: Sr Data Engineer - Scala, Python, Databricks & AWS | Boston, MA (Hybrid)

Tror AI for everyone • Boston, Massachusetts, United States • $0 / year • 1d ago

Role: Sr Data Engineer Scala, Python, Databricks & AWS Location: Boston, MA (Hybrid) Experience: 12+ Years

Job Summary We are looking for an experienced Data Engineer with strong hands-on skills in Scala, Python, Databricks, and AWS to join our financial services client, State Street. The ideal candidate will have experience building and maintaining data pipelines, processing large datasets, and developing scalable data engineering solutions using cloud technologies. The candidate should be comfortable working with financial data and collaborating with technical and business teams. Key Responsibilities Design, develop, and maintain data pipelines using Scala and Python.

Build and optimize data processing workflows using Databricks and Apache Spark.

Develop data engineering solutions on AWS cloud services.

Process, transform, and integrate large volumes of structured and unstructured data.

Write efficient, reusable, and high-quality code.

Troubleshoot data pipeline issues and improve performance and reliability.

Work with databases, data lakes, and other data storage systems.

Collaborate with developers, architects, and business teams to deliver data solutions.

Follow data quality, security, and coding standards.

Required Skills Strong hands-on experience with Scala and Python.

Experience with Databricks and Apache Spark.

Experience building and supporting data pipelines.

Hands-on experience with AWS cloud services.

Strong understanding of data processing, transformation, and ETL/ELT concepts.

Experience working with large datasets and distributed data processing.

Strong problem-solving and debugging skills.

Preferred Qualifications Experience in banking, financial services, or capital markets.

Experience working with cloud-based data platforms and data lakes.

Knowledge of SQL and relational databases.

Experience with data quality, performance tuning, and production support.

Mandatory Requirements Must be willing to work onsite in Boston, MA, 3 days per week.

Must be willing to relocate to Boston if currently based elsewhere.

Must be available for W2 employment only.

Note: Candidates must be comfortable with the hybrid work arrangement and relocation requirement before proceeding with the interview process.